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Abstract — In this paper we consider tlie separate coding 
problem for L + 1 correlated Gaussian memoryless sources. We 
deal with the case where L separately encoded data of sources 
work as side information at the decoder for the reconstruction 
of the remaining source. The determination problem of the rate 
distortion region for this system is the so called many-help-one 
problem and has been known as a highly challenging problem. 
The author determined the rate distortion region in the case 
where the L sources working as partial side information are 
conditionally independent if the remaining source we wish to 
reconstruct is given. This condition on the correlation is called the 
CI condition. In this paper we extend the author's previous result 
to the case where i + 1 sources satisfy a kind of tree structure 
on their correlation. We call this tree structure of information 
sources the TS condition, which contains the CI condition as a 
special case. In this paper we derive an explicit outer bound of 
the rate distortion region when information sources satisfy the 
TS condition. We further derive an explicit sufficient condition 
for this outer bound to be tight. In particular, we determine the 
sum rate part of the rate distortion region for the case where 
information sources satisfy the TS condition. For some class of 
Gaussian sources with the TS condition we derive an explicit 
recursive formula of this sum rate part. 

Index Terms — Multiterminal source coding, many-help-one 
problem, Gaussian, rate-distortion region, CEO problem. 

I. Introduction 

In multi-user source networks separate coding systems 
of correlated information sources are significant from both 
theoretical and practical point of view. The first fundamental 
result on those coding systems was obtained by Slepian and 
Wolf in. They considered a separate source coding system 
of two correlated information sources. Those two sources are 
separately encoded and sent to a single destination, where the 
decoder reconstruct the original sources. 

In the above source coding system, we can consider the 
situation, where the decoder wishes to reproduce one of two 
sources. We call this source the primary source. In this case 
the remaining source that we call the auxiliary source works as 
a partial side information at the decoder for the reconstruction 
of the primary source. Wyner |[2l, Ahlswede and Korner |[3| 
determined the admissible rate region for this system, the set 
that consists of a pair of transmission rates for which the 
primary source can be decoded with an arbitrary small error 
probability. 

We can naturally extend the system studied by Wyner, 
Ahlswede and Korner to the one where there are several 
separately encoded data of auxiliary sources serving as side 

Manuscript received xxx, 20xx; revised xxx, 20xx. 

Y. Ooliama is with the Department of Information Science and Intelligent 
Systems, University of Tokushima, 2-1 Minami Josanjima-Cho, Tokushima 
770-8506, Japan. 



informations at the decoder. The determination of the admis- 
sible rate region for this system is called the many-help-one 
problem. In this sense Wyner, Ahlswede and Korner solved the 
so called one-helps-one problem. The many-help-one problem 
has been known as a highly challenging problem. To date, 
partial solutions given by Korner and Marton ||4|, Gelfand 
and Pinsker 0, Oohama ||1,|[I0|, and Tavildar et al. O are 
known. 

Gelfand and Pinsker IS) studied an interesting case of the 
many-help-one problem. They determined the admissible rate 
region in the case, where the auxiliary sources are condition- 
ally independent if the primary source is given. We hereafter 
say the above correlation condition on the information sources 
the CI condition. 

In Oohama lH, the author extended the many-help-one 
problem studied by Gelfand and Pinsker Q to a continuous 
case. He considered the many-help-one problem for L + 1 
correlated memoryless Gaussian sources, where L auxiliary 
sources work as partial side information at the decoder for 
the reconstruction of the primary source. The mean square 
error was adopted as a distortion criterion between the de- 
coded output and the original primary source output. The rate 
distortion region was defined by the set of all transmission 
rates for which the average distortion can be upper bounded 
by a prescribed level. In jS), the author determined the rate 
distortion region when information sources satisfy the CI 
condition. This result contains the author's previous works 
for Gaussian one-helps-one problem ||6| and Gaussian CEO 
problem f7l|. 

The problem still remains open for Gaussian sources with 
general correlation. Pandya et al. ||9l studied the general case 
and derived an outer bound of the rate distortion region using 
some variant of bounding technique the author ||6| used to 
prove the converse coding theorem for Gaussian one-helps-one 
problem. However, their bounding method was not sufficient 
to provide a tight result. 

In Oohama ifTOI . the author extended the result of IH. 
He considered a case of correlation on Gaussian sources, 
where L + 1 sources satisfy a kind of tree structure on their 
correlation. The author called this tree structure of information 
sources the TS condition. The TS condition contains the CI 
condition as a special case. In ifTol . the author derived an 
explicit outer bound of the rate distortion region for Gaussian 
sources satisfying TS condition. Furthermore, he had shown 
that for L = 2, this outer bound coincides with the rate dis- 
tortion region. The author also presented a sufficient condition 
for the outer bound to coincide with the rate distortion region. 

Subsequently, Tavildar et al. ifTTI extended the TS condition 
to a binary Gauss Markov tree structure condition. They 
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Studied a characterization of the rate distortion region for 
Gaussian source with the complete binary tree structure and 
succeeded in it. To derive their resuh, they made the full use of 
the complete binary tree structure of the source. They further 
determined the rate distortion region for Gaussian sources with 
general tree structure. 

In Oohama IfTOl . the analysis for matching condition of the 
rate distortion region and the derived outer bound was not 
sufficient, so that the author could not realize that there exists 
a part of the rate distortion region where the outer bound 
derived by him coincides with the rate distortion region. In 
this paper we give a further analysis on matching condition 
for the outer bound derived by Oohama [10] to coincide with 
the rate distortion region and derive a condition much stronger 
than the matching condition in ifTOl . Through this analysis 
we obtain an insight on a way of examining the sum rate 
part of the rate distortion region to show that for Gaussian 
sources with the TS condition the minimum sum rate part of 
the outer bound given by Oohama ifTol is tight. This result 
implies that in Oohama ifTOI . the author had already obtained 
an explicit characterization of the sum rate part of the rate 
distortion region before the work by Tavildar et al. ifTTl . On 
this optimal sum rate we derive its explicit recursive formula 
for some class of Gaussian sources with the TS condition. Our 
formula contains the result of Oohama Q for Gaussian CEO 
problem as a special case. 

The rest of this paper is organized as follows. 

In Section II, we present a problem formulation and state 
the previous works. 

In Section III, we give our main result. We first derive 
an explicit outer bound of the rate distortion region when 
information sources satisfy the TS condition. This outer bound 
is essentially the same as the author's previous outer bound 
in ifTOl . but it has a form more suitable than the previous one 
for analysis of a matching condition. Using the derived outer 
bound, we presented an explicit sufficient condition for the 
outer bound to coincide with the inner bound. 

In Section IV, we investigate the sum rate part of the 
rate distortion region. We show that for the outer bound in 
this paper and that in ifTOl . their sum rate parts coincide 
with the sum rate part of the inner bound. Hence, in the 
case where information sources satisfy the TS condition, we 
establish an explicit characterization of the sum rate part of 
the rate distortion region. This optimal sum rate has a form of 
optimization problem. For some class of the Gaussian source 
with the TS condition, we solve this optimization problem to 
establish an explicit recursive formula of the optimal sum rate. 

In Section V, we give the proofs of the results. Finally, in 
Section VI, we conclude the paper. 

II. Problem Statement and Previous results 

In this section we state the problem formulation and pre- 
vious results. We first state some notations used throughout 
this paper Let $ = {1, 2, ■ • • , |$|} and A, « £ $ be arbitrary 
sets. Consider a random variable Ai,i G $ taking values in 

A- We write n direct product of Ai as A^^ — Ai y. ■ ■ ■ y. Ai . 




Fig. L Communication system with L side informations at the decoder. 

Let a random vector consisting of n independent copies of the 
random variable Ai be denoted by Ai = Ai^iAi^2 ■ ■ ■ Ai^n- 
We write an element of Af as = ai,iai,2 ■ ■ -ai^n- Let S 
be an arbitrary subset of $. Let ^5 and As denote random 
vectors {Ai)i^s and {Ai)i^s^ respectively. Similarly, let as 
denote a vector (ai)igs- When S = {k, k + 1, ■ ■ ■ ,1}, we also 
use the notation Aj, for As and use similar notations for other 
vectors or random variables. When fc = 1, we sometimes omit 
subscript 1 . Throughout this paper all logarithms are taken to 
the natural. 

A. Formal Statement of the Problem 

Let Xi^i ~ 0, 1, 2, • • • , L be correlated zero mean Gaus- 
sian random variables taking values in real lines Xi. Let 
A = {1, 2, • • ■ , L}. The CI condition Oohama [O treated cor- 
responds to the case where Xi , X2 , X^ are independent 
if Xq is given. In this paper we deal with the case where 
Xi, • • • , Xl have some correlation when Xq is given. Let 
{{Xo^t, Xi^t, ■ ■ ■ , -^L,t)}^ibe a stationary memoryless multi- 
ple Gaussian source. For each t = 1, 2, ■ • •, (Xo,t, Xi^t, ■ ■ ■ , 
XL,t) obeys the same distribution as (Xq, Xi, • • •, Xl) . 

The multiterminal source coding system treated in this paper 
is depicted in Fig. [T] For each i = 0,1, • • the data 
sequence Xi is separately encoded to ipi{Xi) by encoder 
function ipi. The encoded data ifi{Xi)^ i = 0, 1, • • ■ , L are sent 
to the information processing center, where the decoder ob- 
serves them and outputs the estimation Xq of Xq by using the 
decoder function il). The encoder functions (/^j , i = 0, 1, • • • , L 
are defined by 

ifr-Xl^ ^M, = [1,2,- ■■, Ah} (1) 

and satisfy rate constraints 

-\ogM,<R,+5 (2) 
n 

where 5 is an arbitrary prescribed positive number The 
decoder function ip is defined by 

: TWo X All X • • • X TWl A-g" . (3) 

Denote by J^]"''(i?o, ^17 • ■ ■ 7 Rl) the set that consists of 
all the (L + 2) tuple of encoder and decoder functions 
((ySo, V17 ■ ■ ■ 7<y'L7 "0) satisfying (Uli-®. Let d{x,x) = (x — x)"^, 
{x, x) G Xq be a square distortion measure. For Xq and its 
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estimation Xq = il;{ipoiXa),(pi{Xi), ■ ■ ■ ,ipLiX l)), define 
the average distortion by 

1 " 

A(Xo, Xo) = - V Ed{Xo,u Xo,t) . 
n ^ — ' 

t=i 

For a given D > 0, the rate vector {Rq, Ri, ■ ■ ■ , Rl) is 
admissible if for any positive 6 > and any n with n > no{S), 
there exists (cpo, <y3i, • • • , '/'l, V') ^^s'^\Ro,Ri, • ' ' : ^l) such 
that A{Xq,Xq) < D + S. Let 7^L(£') denote the set of all 
the admissible rate vector Our aim is to characterize TZi (D) 
in an explicit form. On a form of TZl{D), we have a particular 
interest in its sum rate part. To examine this quantity, define 



Rsum,L{D,Ro) = min ^1 ^« r • 

To determine Rsuin,L{D, Rq) in an explicit form is also of our 
interest. 

By the rate-distortion theory for single Gaussian sources, 

when i?o > ilog+[^], Ri = R2 =■ ■ ■ = Rl = is 
admissible. Here log^ a = max{loga,0}. Hence, we have 

7^L(i?)n|i^o>ilog+[4^] 

= {{Ro,Ri,---,Rl) : i?o > 5log+[%^] 
Ri>0,i£A}. 

Throughout this paper we assume that D < and i?o < 

B. Tree Structure of Gaussian Sources 

In this subsection we explain the tree structure of Gaussian 
source which is an important class of correlation. Consider 
the case where the L + 1 random variables Xq, Xi, - ■ ■ , Xl 
satisfy the following correlations: 



^0 — X(), 

Yi=Yi^i+Zi,l<l<L, 
Xi=Yi+Ni,l<l<L-l, 
Xl = Yl,Nl = Zl, 



(4) 



where , i G A are L independent Gaussian random variables 
with mean and variance a^, and Ni, i ~ 1,2, • • • , L — 1 are 
L — 1 independent Gaussian random variables with mean 
and variance aj^. . We assume that is independent of Xq 
and that iV^~^ is independent of Xq and Z^. We can see that 
the above {Xq,Xi, • ■ • , X^) has a kind of tree structure(TS). 
We say that the source (^Xq, Xi^ • • ■ ^ X^) satisfies the TS 
condition when it satisfies (HJi. The TS condition contains the 
CI condition as a special case by letting , « = 1, 2, • • • , L—1 
be zero. Let S be an arbitrary subset of A. The TS con- 
dition is equivalent to the condition that for S" C A, the 
random variables Xs, (ATq, Z^^^), ATgc form Markov chains 
Xs {Xq,Z^-^) Xgc in this order. The TS and CI 
conditions in the case of L = 4 are shown in Fig. |2] and [5] 
respectively. 




Fig. 2. TS condition in the case of L = 4. 
^0 




Fig. 3. CI condition in the case of L = 4. 

C. Previous Results 

In this subsection we state the previous results on the 
determination problem of TZl{D). Let [7^, z = 0, 1, • • ■ , L be 
random variables taking values in real lines Ui. For 5 C A, 
define 

Q{D)= {{Uo,U^) : {Uo,U^) is a Gaussian random 
vector that satisfies 



Us^X 



su{o} 



for any 5 C A and E[Xo - 4!{Uo, U^)]^ < D 
for some linear mapping ^ -.Uq x Xq . } , 



where S'' = A - S. Let 



1 • • • i 

7r(l) • • • 7r(i) 



L 



be an arbitrary permutation on A and 11 be a set of all 
permutations on A. For S* C A, we set 7r(S') ~ {7r(j)},;gs- 
Define L subsets Si,i ^ 1, 2, • • ■ , L of A by Si = {i, i + 1, 



• , L} . Set 



A 



{{Rq, • • • , Rl) '■ There exists a random 
vector {Uq, U^) G Q{D) such that 
Rq>I{Xq-Uq\U'^) 

fori = 1,2,---,L} , 
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Uen J 



where conv{A} denotes a convex hull of the set A. Then, we 
have the following. 

Theorem 1 (Oohama For Gaussian sources with gen- 
eral correlation 

7^f^(z?) c7^L(^?). 

For Gaussian sources with the CI condition the inner bound 
7^^™^ [D) is tight, that is 

n^^\D) = nL{D). 

The above inner bound n'i''\D) can be regarded as a 
variant of the inner bound which is well known as the inner 
bound of Berger 1(121 and Tung ITSl . Theorem [T] contains 
the solution that Oohama JS) obtained to the one-helps- 
one problem for Gaussian sources as a special case. When 
Rq = 0, the second result of Theorem[T]has some implications 
for the Gaussian CEO problem studied by Viswanathan and 
Berger |fl4| and Oohama [7| and source coding problem for 
multiterminal communication systems with a remote source 
investigated by Yamamoto and Itoh [IS] and Flynn and Gray 

m- 

The notion of TS condition for Gaussian sources was first 
introduced by Oohama JTOj. Tavildar et al. IfTTI extended 
the TS condition to a binary Gauss Markov tree structure 
condition. They studied a full characterization of the rate 
distortion region for Gaussian sources with a binary tree 
structure. In the next section we shall state the results of 
Tavildar et al. ifTTl and compare them with our results. 



III. Results on the Rate Distortion Region 

In this section, we state our main results on inner and 
outer bounds of TZl{D) in the case where {Xq, Xi, • ■ • , X^) 
satisfies the TS condition. 



A. Definition of Functions and their Properties 

In this subsection we define several functions which are 
necessary to describe our results and present their properties. 
Let Ti, i G A be nonnegative numbers. Define the sequence of 
nonnegative functions {fi{rl^)}^Si U{/o(r^)} by the follow- 
ing recursion: 



fL-i{rLi) 



_ 1- 


— 2rT 1 

-e 1 












(n+i) 











L~2>1>\, 



(5) 



Next, we define the sequence of nonnegative functions 



by the following recursion: 

go{D,ro) = - 



gi+i{D,ro,r^) ^ 

ff,(£',r-oy-i)-^(l-c-^n) 



g,{D.ro,r'-i)--^(l-c-2'-l) 



(6) 



l<l<L-2, 

where [a]+ = max{a,0}. Let Bl{D) be the set of all 
nonnegative vectors that satisfy 



1 

'^0 



Let dBL{D) be the boundary of Bl{D), that is, the set of all 
nonnegative vectors that satisfy 

/o(r^)=ffo(Aro)-^--^. 



We can easily show that the functions we have defined satisfy 
the following property. 
Property 1: 

a) For each z G A, /o (r^ ) is a monotone increasing function 
of r,;. For each \ <l < L and for each i = /, Z + 1, • • • , L, 
fi{r[) is a monotone increasing function of r,;. 

b) For each 2 < I < L — 1 and for each i — 0,1, ■ ■ ■ ,1 — 1, 
gi{D ,rf),r^~^) is a monotone decreasing function of r.i. 

c) If e Bl{D), then, for < ? < L - 1 , 

gi{D,ro,r'-')<Mri^). 

In the above L inequalities the equalities simultaneously 
hold if and only if G dBL{D) . 

Define 

L-l 



1=1 

L-l 

G{D,ro,r^~')=l[ [l + ^o, r'-^) 



For 5* C A, define 



A 



Mrs) = foin 



1=1 



rsc=0 



Firs)= F{r^)\ 



rsc=0 ■ 



{gi{D,ro)}i=o.iU{giiD,ro,r'-')}l 



L-l 



We can easily show that the functions F{r^) and G{D,ro, 
r^~^) satisfy the following property. 
Property 2: 

a) For each i Q S, F{rs) is a monotone increasing function 
of n. 

b) For each i = 0, 1,---,L - 2, G{D,ro,r^-^) is a 
monotone decreasing function of r^. 

c) If G BlID), then 

G(i5,ro,r^-2) <F(r^). 
The equality holds if and only if G dBL{D) . 
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For D > 0, n > 0, i e A and S C A, define 



Js{D,ro,r^-^,rs\rs^) 



A 1 



log^ 



-2ro 



2 ^ 



F(r^) 1+°;xo/q('' ) 



We can show that for S C A, Ks{rs\ rs<^) and Js{D,rQ, 
r^~'^ ,rs\rs<:) satisfy the following two properties. 
Property 3: 

a) If e iSiC-D), then, for any S C A, 



The equality holds when Tq g dBL{D). 
b) Suppose that G Bl{D). If r^|^ still belongs to 
BlCI?), then. 



= 0. 

Property 4: Fix e Bl{D). For 5 C A, set 



A 



PS = Ps{rs\rs-) = Js{D,ra,r^ ^fsksO • 



By definition it is obvious that ps,S C A are nonnegative. 
We can show that p = {ps}scA satisfies the followings: 

a) p0 = 0. 

b) PA < PB for ACBCA. 

C) PA + PB < PAnB + PAUB ■ 

In general (A, p) is called a co-polymatroid if the nonnegative 
function p on 2^ satisfies the above three properties. Similarly, 
we set 



A 



PS = Psirs\rs-=) = Ks{rs\rs-=) , p = {ps} 



SCA ■ 



Then, (A, p) also has the same three properties as those of 
(A, p) and becomes a co-polymatroid. 



B. Results 

In this subsection we present our results on inner and outer 
bounds of TZi{D). In the previous work ifTol . we derived 
an outer bound of TZl{D). We denote this outer bound by 



5 (out) 



7^ 



(D). According to EO), n'i''^\D) is given by 



^(out)p^ 



: There exists a nonnegative vector 
(''Oi ''^) such that 

Ro>ro>h log^ 



Ri > Ti for any i G A, 
Rq + Ri 



ies 



> - log^ 
- 2 B 



^(rsc){l+<Tj^/o(rsc)}D 



for any 5 C A .} 



Set 



(out) 



A 



{{Ro,Ri,---,Rl) ■■ 
Ro>ro, 

ies 

for any 5 C A . } , 



A 



{{Ro,Ru---,Rl) ■■ 
Ro>ro, 

^Rt > Ks (rslrs-) 
ies 

for any 5 C A . } , 



u 



Our main result is as follows. 

Theorem 2: For Gaussian sources with the TS condition 



^^(out;^^ ^^p;^^^^ 

Proof of this theorem will be given in Section V. The 
inclusion TZl{D) C 7^^"'-'(D) and an outline of proof of 
this inclusion was given in Oohama ifTOl . Furthermore, by 
Theorem[ri we have {D) C TZl{D). Hence, it suffices to 



(out) 



show 7e<°""(Z?) C nr"'{D) and TZ'l''>{D) C TZ'l''>{D) to 
prove Theorem [2] Proofs of those two inclusions will be given 
in Section V. We can directly prove TZl^D) C 7?.^"'''(I?) in 
a manner similar to that of Oohama i flOl . For the detail of the 

,(out) 



J (out 



direct proof of TZl{D) C V}^'^'"' {D), see Appendix B 



An essential difference between 'R}t^^\D) and 'R^jf' {D) 



is the difference between Js{D,rQ, r 



L-2 



definition of 7?.^"'^(£') and Ks{rs\rs<:) in the definition 
of 7^i'"''(_D). By Property |3] part a) and the definitions of 



rslrs- 



in the 



7^^™*^(Z?,r^) and TZ'l''' { r^), if G dBL{D), then. 



,(m) 



7^' 



(out) 



(Aro^)=7er'(ro^). 
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Fig. 4. TS conditions in tlie case of L = 2 and the case of L = 3 and 
Z2 = 0. 



This gap suggests a possibility that in some cases those two 
bounds match. In the following we present a sufficient con- 
dition for n^°''^\D) C n^l''\D) . We consider the following 
condition on G{D,ro, r^~^). 

Condition: For each ? = 1, 2, ■ • • , c'^'''G{D, ro,r^-^) 
is a monotone increasing function of r;. 

We call the above condition the MI condition. The following 
is our main result on a matching condition on inner and outer 
bounds. 

Lemma 1: For Gaussian sources with the TS condition if 
G{D,ro,r^~^) satisfies the MI condition, then. 

Proof of this lemma is given in Section V. Note that when 
L = 2 or (Tzi = 0, for I ~ 2,3, ■ ■ ■ , L — 1 under the TS 
condition, we have 

G(Aro,r^-') = l + a|^5i(^,r-o), 

which satisfies the MI condition. TS conditions in the case 
of L = 2 and the case of i = 3, Z2 = is shown in Fig. 
|4] Note that those two conditions are different from the CI 
condition. Combining Lemma [T] and Theorem |2] we establish 
the following. 

Theorem 3: For Gaussian sources with the TS condition 



Furthermore, if G{D,ro,r^~^) satisfies the MI condition, 
then. 



_ -TP (out) , 



_ -r,(out) , 



,(out) , 



2 (D) was 



In Oohama ITOl, the equality 712(0) ^ TZ. 
stated without complete proof. We can see that this equality 
can be obtained by Theorem |2l Lemma [T] and the fact that 
the MI condition holds for L = 2. 

Next, we present a sufficient condition for G{D,ro,r^^^) 
to satisfy the MI condition. Let {fj}f^i be a sequence of 
positive numbers defined by the following recursion: 



1 



,L-2> 1>1 



(7) 



By definition it is obvious that /; {rf" )</;*. Then, we have 
the following proposition. 



Fig. 5. TS condition in the case of L = 3. 
Proposition 1: If 

Elr(i+4.,.Av)n (1+4./;)' <i (8) 

k=l ' j=l + l 

hold for Z = 1, 2, ■ • • , L - 2, then, G{D, tq, r^~^) satisfies the 
MI condition. 

Proof of this proposition will be given in Appendix A. It can 
be seen from this proposition that for L > 3, the MI condition 
holds for relatively small values of cr^j ,/ = 2,---,L — 1. In 
particular, when L = 3, the sufficient condition given by (HI 
is 



Solving the above inequality with respect to (t|^, we have 



The TS condition in the case of L = 3 is shown in Fig. |5] 

C. Binary Tree Structure Condition 

As a correlation property of Gaussian source Tavildar et al. 
Ifm introduced a binary Gauss Markov tree structure condi- 
tion. They studied a full characterization of the rate distortion 
region for Gaussian sources with this binary tree structure. In 
this subsection we describe their result and compare it with 
our results. 

We first explain the binary tree structure introduced by 
them. Let A: be a positive integer We consider the case where 
L = 2''. Let < i < 2^,1 < j < k, be zero 

mean independent Gaussian random variables with variance 
cr^y). Those 2*^+^ — 2 random variables are independent of 

Xq. Define the sequence of Gaussian random variables {y/"''' 
}i<i<2J,o<j<fe by the following recursion: 



(0) 



for 1 < i < 2J,0 < j < fc, 



(9) 



X, = Y' ' , for 1 < i < 2*= 



where \a\ stands for the smallest integer not below a. We 
say that for L = 2^ the Gaussian source {Xq,X\, ■ ■ ■ , X^) 
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Fig. 6. BTS condition in the case of L = 4. 




Fiff. 7. BTS condition in the case of L = 4, a 



oo and A^. 



(2) 



is equivalent to the TS condition in the case of L = 3 and Zi = 0. 

satisfies the binary tree structure (BTS) condition when it 
satisfies (|9]l. The binary tree structure in the case of fc = 2 
and L = 2'^ = 4 is shown in Fig. |6] In this example, let 



oo and Nr 



(2) 



0. Then, Xi becomes independent 



of {X2, X^, X4) and {X2, X3, X4) has the same correlation 
property as the TS condition in the case of i = 3 and Zi = 0. 
The BTS condition in this case is shown in Fig. |7] In general 
the set of Gaussian sources satisfying the TS condition and 
Zi = can be embedded into the set of Gaussian sources 
satisfying BTS condition. 

The communication system treated by Tavildar et al. is 
shown in Fig. |8] It can be seen from this figure that their 
problem set up is slightly different from ours. In their commu- 
nication system there is no encoder that can directly access to 
the source Xq. Tavildar et al. studied a characterization of the 
rate distortion region 7^.^(1?) n{i?o = 0} for Gaussian sources 
with the binary tree structure and succeeded in it. Their result 
is the following. 

Theorem 4 (Tavildar et al. hill): When L = 2^ for some 
integer k and (Xo,Xi, • • • ,Xl) satisfies the BTS condition, 
we have 

tIl{d) n {Ra = 0} = n^t\D) n {i?o = 0} . 

From the above theorem we have the following corollary. 
Corollary 1 (Tavildar et al. UTj): When (Xq, Xi,--- ,Xl 
) satisfies the TS condition and Zi = 0, we have 

tIl{d) n {Ra = 0} = nt^{D) n {Ra = 0} . 

The BTS condition differs from the TS condition in its 
symmetrical property, which plays an essential role in the 
proof of Theorem |4] We think that the method of Tavildar 




Fig. 8. Communication system that Tavildar et al. treated. 



et al. ifTDl is applicable to the general case where Zi is not 
constant and i?o > and that TlLiD) = n1''\D) still holds 
in this general case. 

Unfortunately, our approach developed in ITOl and this pa- 
per can not establish TZl (D) = Iz'"™^ (D) for Gaussian sources 
satisfying the TS condition without requiring the condition on 
the variances of Zi,2 < i < L — 1 and Ni,l < i < L, 
specified with ([8]l in Proposition [1] However, we think that 
our work in |[TOl had provided an important step toward the 
full characterization of the rate distortion region established 
by Tavildar et al. Hi]. 

IV. Sum Rate Part of the Rate Distortion Region 

In this section we state our result on the rate sum part of 
ULiD). Set 



RsL.LiD,Ro)^ min MD,Ro,r^-',r^), 

r^:/o(r^) 
>3o(-D,-Ro) 



A 



A 



r^:/o(r^) 
>3o(-D,-R^o) 



Let -Rg^jjj i{D, Ra) be the minimum sum rate for TV-^^"^' {D), 
that is. 



j(out) , 



(/?o,-Ri,--vfli,)e7t<°"''(D) — 



Then, it immediately follows from Theorem |2] that we have 
the following corollary. 

Corollary 2: For Gaussian sources with the TS condition 

^iLL(Ai?0)<i?ll,L(Ai?0) 
<i?sum,L(Ai?0)<i?ll,i(Ai?0). 

On the other hand, we have the following lemma. 

Lemma 2: For Gaussian sources with the TS condition, we 
have 

<LL(^'^0)>i?ll,i(Ai?0). 

Proof of this lemma will be given in Section V. Combining 
Corollary |2] and Lemma |2] we have the following. 
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Theorem 5: For Gaussian sources with the TS condition 

1 



mm 

'-^:/o(r^) 
=go(C,-Ro) 

1 



L 

^n + ^logF(r^) 
L/=l 



log 
2 Z? 



The optimal sum rate Rsuni,L{D, Rq) has a form of opti- 
mization problem. In the remaining part of this section we 
deal with this optimization problem. For 1 < / < L, set 
cr|^^ ~ (jf, cr^, = ^if^f ■ the TS condition el should be one. 
For some class of Gaussian source satisfying TS condition, we 
solve the optimization problem to derive a parametric form of 
Rsum,L{D, Rq). The recursion ^ is 



flirt ) , 

for L>1>2, 
/i (''"-) 



(10) 



l+ei^f/iCr-f-) 

The optimization problem presenting Rsum,L{D, Rq) is 



R, 



'Sum.L 



{D,Ra 



= mm 

1 



■ L 

E 

.1=1 



ri 



1=1 



-Rn 



2 D 



Set 



A 



1 + 



for L > / > 1 



(11) 



By the above transformation, we transform the variable 
into a^. From ( fTTT i. we have 



/; = ./;(rf) = 



1 



erf 1 - eiai 



, for i > / > 1 , 



(12) 



Note that /; > for L > / > 1. Then, form ai, L > I > 

1 must satisfy < a; < e^^- L > I > 2, sel ti= erf /af_i. 
From ([Tol l and (fT2] l. we have 



-2n_ 



1 



ai 



.- — , for L > ? > 2. (13) 

1 - e/Q;/_i r; 



Since n_i > for i > Z > 2 and O, ai,L> I >2 must 
satisfy 



< a; < - 



(^^^ l) 



- 1 <«(<£, 



(14) 



Let n^^ifOj^r^) be a L direct product of the semi-open 
intervals [0, ef^), 1 < I < L. Let Al be a set of all L 
dimensional vectors £ Y[f=i I^i ef^) ^^^at satisfy ( fT4] l. 



Using a^, Rsum,L{D, Rq) is rewritten as 

sum.iv 



mm 

Q2 e-4t(ai) 

"l='^l9o(-D,-Ro) 



E (log (i - Y 
1=1 ^ ^ 



m+i 

n+i 



+ log (1 - eiai) > + log(l - ah 



—Rn 



^ 1 "Xo 

2^°S^ 



A 



where AL{ai) = : — (aijaj) G Al} ■ To solve the 
above optimization problem, set 



c = cc 



"^)"E|iog(i-T 



+ log(l - eiai) 



Tl + l 

- log(l - Ul) 



Then, we have the following lemma. 

Lemma 3: For G ^(ai), C(Q!2 ) is strictly concave with 
respect to 

Proof of this lemma will be given in Appendix C. It can 
be seen from this lemma that if we can find 62 satisfying VC 
l^L^gL = and 6*2 G AL{(^^go{D, Rq)), this 62 is the unique 
vector which attains Rsuni,L{D, Rq). We shall give such 62 
in an explicit form of recursion. Let ui G [0, 1). Define the 
sequence of functions {0i{oj)}f^^ by the following recursion: 



9l{uj) = uj, 
Ol-i{lo) 



29i,(c^)-l 

TL 



l + CL-l 



26)L(t^)-l 



H = 



29i{lu) - 



1+ 



1 



l + ei 1+ 



Tl 



20,(t^) 



for L - 1 > / > 2 . 



(15) 

Then, we have the following lemma. 

Lemma 4: The sequence of functions {di{uj)}f^i defined 
by (fTsT l satisfies the followings. 

a) Suppose that r/ = L > I > 2 satisfy the 

following condition. 



Tl > 1, for I = i, 



Tl > 



1+ei 



for L - 1 > I > 2. 



Then, for L > I > 2, we have the following. 



(16) 



(17) 



The above O imply that 6^(10) G ^L(6'i(tj)). 
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b) 



c) For each L — 1 > I > 1, di{uj) is differentiable with 
respect to cu G [0, 1) and satisfies the following; 



> 



2{L-l) 



L-{1+1) 



n 



n 



ai - 
> 0. 



This implies that for each 1 < I < L, the mapping ui £ 
[0, 1)^ di{uj) is an injection. 
Proof of this lemma is given in Appendix D. From this 
lemma, we obtain the following theorem. 

Theorem 6: Let {Oi{'-o)}f^i be a sequence of functions 
defined by ( fTSl l. Suppose that the Gaussian source satisfies the 
TS condition and the condition ( fT6] l stated in Lemma |4] Then, 
we have the following parametric form of Rsuni.L{D, Rq) with 
the parameter w £ [0, 1): 



Rs 



.{D,Ro) 



L-l 

E 

1=1 



log 1 



Oliuj) 



-Ro 



— log 
2 ^ D 



1 - ei9i{u;) Ti+i 



+ log{l~ei9i{uj)) ^+log(l-w) 



When ez = for L - 1 > Z > 1 and r/ = 1 for L > ; > 2, 
the recursion (fTSl l becomes the following: 

0i_iH = 20,H-^i+i(^) > (18) 
for L - 1 > / > 2 . J 

Solving (fTSl l. we obtain ^((a;) = (L — Z + The parametric 
form of Rsuni,L{D, Rq) becomes 

ajgoiD,Ro)^eiiuj)^Lu;, 



Rsum,L{D, Rq) 



From ( IT9] ). we have 



-^^ )log(l-c.) 



(19) 



i?.um,L(-D,i?o) = ( log ("l - ^goiD,Ro: 



1 



-^0 



(20) 



In particular, by letting Rq ^ Q and L ^ cx) in ( |20l ). we have 



lim i?„ 



Xo 



— log 
2 ^ D 



2a\ 



1 



- log — - . 
2 ^ D 



The above formula coincides with the rate distortion function 
for the quadratic Gaussian CEO problem obtained by Oohama 
Q. Hence, our solution to Rsum.L{D, Ro) includes the pre- 
vious result on the Gaussian CEO problem as a special case. 

V. Proofs of the Results 

In this section we prove Theorem |2] and Lemma [T] stated in 
Section III and prove Lemma |2] stated in Section IV. 



A. Derivation of the Outer Bound 

In this subsection we prove TZ^°'-''\d) C 7^i™"(^?) stated 
in Theorem ID 

Proof of TZ^°'''\d) C 7^(°"')(D).• Set 



JsiD,ro,r ,rs\rs<^,Ro) 



1 



■log 



^(rsc){l+^|^/o(rsc)}n 



J2^■^-R0 



1=1 



We first observe that 

Js{D,rQ,r^~'^,rs\rs^,ro) 

log+ 



1 

> - 

- 2 



log 



= Js{D,ro,r^-\rs\rs^) . 
Then, we have the following. 



F ^ 2r, - 2ro 

i=l 
L 

2r, - 2ro 



(21) 



n 



(out) 



(^) 



(a) 



.aw , 

C < [Rq,R ) : There exists a nonnegative vector 
(ro, r^) such that 



i?o > r-o > - log^ 



(b) 



{l+-Xo/o(-^)}^ 

> Js(i?,ro,r^-^rs|rsc,i^o) 

for any S" C A .} 

|(i?o,-R^) : There exists a nonnegative vector 
such that 
1 



Y^R, > JsiD,Ro,r''-^rs\rs^,Ra) 
ies 

for any 5 C A .} 
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c 



{{Ro, 



(c) 

c 



: There exists a nonnegative vector 
(ro, r^) such that 

Ro>ro> - log -j i— 

ro,r^ '^,rs\rs-,ro) 

i<£S 

for any S" C A .} . 

|(i?o,fi^) : There exists a nonnegative vector 
(ro, r^) such that 



Ro>ro>- lo; 



{i+-io/o('-^)|^ 



forany A.} = 7^^°"*^(D). 

Step (a) follows from the definition of Js{D,Rq, 
r5c,i?o) and the nonnegative property of R^. Step (b) fol- 
lows from that Js{D,ro, 



„L-2 



rs 



„L-2 



J 7'5|?'5c, i?o) is a monotone 
decreasing function of rg. Step (c) follows from ( I2TI 1. Thus 
7ti™*^(Z?) C 7^(°"*^(i?) is proved. ■ 

B. Derivation of the Inner Bound 

In this subsection we prove T?.^"' (D) C Tt^"' (Z?) stated in 
Theorem |2] We first derive a preliminary result on a form of 
7^^"'(L»). Fix Ro > ro and set 

nPir^\Ro) = {iR^r--,RL): 

iRo,Ri,---,RL)en'^i''\r^)}. 

Let (A, p), p — {/5s(r5|r5c)}5CA be a co-polymatroid defined 
in Property m Expression of 7^^'"'' (rg |i?o) using (A,/5) is 

<'"^(r^|i?o) = {(i?i,---,i?L) : >P5 (r-sksO 

for any S' C A .} . 

The set 7?.^"''(ro |i?o) forms a kind of poly tope, which 
is called a co-polymatroidal polytope in the terminology of 
matroid theory. It is well known as a property of this kind 
of polytope that the polytope TZ^™\ro |i?o) consists of L\ 
end-points whose components are given by 



RTT{i) 

P{7r(i),---,7r(L)}('"{ir(i),---,7r(L)}k{7r(l),---,ir(i-l)}) 
-P{7r(i+l),--v7r(L)}(''{7r(i+l),---,7r(L)}k{7r(l),---,7r(i)}) 

for i = 1, 2, • • • , L — 1 , 

Rtt(L) = /5{7r(L)}('V(L)k{7r(l),---.7r(L-l)}) , 



(22) 



where 



1 ■•■ i ■■■ L 

7r(l) • • • Tr{i) ■ ■ ■ tt{L) 



e n 



is an arbitrary permutation on A. For each tt G 11 and 
Tq G Bl{D), let v}™j^{ro) be the set of nonnegative vectors 



{Ro,Ri, - ■ ■ ,Rl) satisfying 

i?o >r-o 
R 



■7T{i) 

> P{n{i),-,7r{L)}{r{^(^i)^...^^(^L)}\r{nil),-,7T{i-l)}) 

-P{77(i+l),---.7r(L)}(''{7r(j+l),---,7r(L)}k{7r(l),--.7r(t)}) 

for i 1,2,- • •,L - 1 , 

R7,(L) > /5{7r(L)}(r^(L)|r{7r(l),...,7r(L-l)}) • 



(23) 



Then, we have 



7^(-)(r„^) = conv (J <l(^o: 



(.Tien ) 

Proof of n^L\D) C n'i"\D): Fix tt G H and 
Tq G Bl{D) arbitrary. By ( l23T l, it suffices to show that for 
rj^ G Bl{D), n'^':l{r^) C TZ'^^iD) to prove 71^(0) C 
(D). Let Vi,i IE {0}UA be independent Gaussian random 
variables with mean and variance ay,. Suppose that Vq^ 
is independent of Xq- Define the Gaussian random variables 
U^,i G {0}U A by 

U, = X, + V,, ^G{0}UA. 

From the above definition it is obvious that 

[/^ ^ ^ Xo ^ Uo, 



Us 

for any S* C A . 



(24) 



when 



For given r, > 0, i G S' and D > 0, set = 

Ti > 0. When = 0, we choose Ui so that Ui takes the 
constant value zero. Define the sequence of random variables 

mt=o by 



L-l 



Ul 



^/ — 1 7 7~l T ■ + ~ — T " ■ Ul 



for L - 2 > / > 1 



> (25) 



Note that f^o = ^q{U^) is a linear function of . Then, by 
an elementary computation, we have 



Xo = 



1 



"0 : 



(26) 



where Nq is a zero mean Gaussian random variable with 
variance 



-1 



-^0 ^0 

Nq is independent of [Uq, U^). Since G Bl{D), we have 
^-^</o(r^). (27) 

We put 



(28) 
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Then, from dZT] ) and ( |28T l. we have 



foir 



1 , l-c-^'-o 

^0 



+ /o(r^) 



< D . 



(29) 



Based on 
(C/o,C/^)by 



and (129b . define the hnear function i]j of 



Then, we obtain 



E 



Xo-ij{Uo,U 

1 I l-c-^''" 



= Var 



+ /o(r^) 



< D . 



(30) 



From dsn and we have (Uq,U^) G 5(1?). By simple 
computations, we can show that 

ro = /(Xo;?7o|[/^), 
= /(Xi;C7,|Xor^-i), 
for any z S A , 

ilog [^^5(rs)-{l + ^l:„/o(rs)}] 

for any S* C A . 
Using (l24l i and dSTI i, the i + 1 inequahties of (|23] l are rewritten 



(31) 



as 

i?o > /(Xo;[/o|[/^), 

+I{XT,(iy,UT,{i)\XQY'"^^) 

= /(Xor^-i;[/^(,;);|(7,(5c)) 

+I{X^(^iy,U^(^)\X^Y'"~'^U^{^S'r)) 

for i = 1,2, • • 

Thus, we conclude that (i?0 7 -^77(1)1 • ' ' 7 R-n(L)) G ^I-'lC^)- 
■ 

C. Proofs of Lemmas\l\and\2\ 

In this subsection we prove Lemmas [T] and |2] We first 
present a preliminary observation on 7?.^°^*'' (D). Fix Rq > vq 
arbitrary and set 

iRo,Ru---,RL)^n^r'\D,r^)}. 

Let (A, p), p = {ps(''s|''sO}scA be a co-polymatroid defined 
in Property m Expression of 7?.^°"*^ (Dq, ?'o l-Ro) using (A, p) 



IS 



7^ 



(out) 



(i^,r^|i?o) = {(i?i,---,i?L) : ^-"S (rsM 



ies 

for any 5 C A .} . 

(D, Tq |i?o) forms a co-polymatroidal polytope. 
The polytope T?.^""*"* (D, Tq |i?o) consists of LI end-points 
whose components are given by 



The set TZ 



(out) 



R-n-ii) 

P{7r(i),---,7r(L)}(»'{7r(i),---,7r(L)}k{7r(l),---,7r(t-l)}) 
-P{7r(i+l),---,7r(L)}(''{7r(i+l),---,7r(L)}k{7r(l),---,ir(i)}) 

for i = 1, 2, • • • , L — 1 , 

RiriL) = P{7T{L)}{r^{L)\r{T,(l),...^n{L-l)}) , 



(32) 



where 

1 ••• i ••• L 

Tr{l) ■ ■ ■ Tr{i) ■ ■ ■ 7r(L) 

For each tt G 11 and Z = 1, 2, • • • , i, set 



G n. 



B^,i{D) " {r^ : E Bl{D) and 

'''■n(i) = for i = Z + 1, ■ 

dB^j{D) = {r^ : G dBL{D) and 



'^7r(j) 



for i = Z + 1, 



In particular, when tt is the identity map, we omit tt to write 
Bi{D) and dBi{D). By Property El when G S^.Ki'), the 
end-point given by ( |32] | becomes 

^ir(i) 

= P{7r(i).---,7r(i)}('"{7r(t),---,7r(0}k{7r(l),---,7r(i-l)}) 

-P{7r(i+l),--v7r(0}(''{7r(j+l),---,7r(i)}k{7r(l),---,7r(i)}) 

for i = 1,2,- • / - 1 , 

^fr(;) = P{7r(;)}(^7r(i)k{ir(l),---,7r(;-l)}) , 



= 0, fori = ? + l,---,L. 



Next, we present a lemma on a property of G(D, tq, r 



(33) 



L-l\ 



Lemma 5: For Tq G Bi{D), G{D,ra, 



is computed 



as 



G(i?,ro,r^~') 



n[l + 4.5fc(Aro,r'^-^)] 



fc=i 



Proof: By Property [T] part c), for / + 1 < fc < L 

0<gfc(i^,ro,r'=-i) </(r^) =0. 

Hence, the result of Lemma |5] follows. ■ 
Proof of Lemma\J] Fix tt G 11 and Tq G Bl{D) arbitrary. 
Let (i?o, R^) be a nonnegative rate vector such that _Ro > 
and L components of R^ satisfy ( |32] i. To prove Lemma [T] 
it suffices to show that this nonnegative vector belongs to 
TZ'f\D). For / = 1,2,-- we prove the claim that under 
the MI condition, if Tq G Bt,-j{D), then, the rate vector 
{Ro,R^) satisfying R^ > tq and ^ belongs to n^l^\D). 
We prove this claim by induction with respect to I. When 
I = 1, from ( [33] l, we have 



Rtt(,1) — P{7r(l)}(^ir(l)) 7 

^7r(i) ==0, for i = 2, • • • , L . 



(34) 
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The function P{,r(i)}(''7r(i)) is computed as 

= "^{7r(l)} (^,'"0,f^~^7■7r(l)k{7r(l)}■=) 



= 2 log 



'-{„(1)}C=U 



D 



(35) 



By the above form of P{7r(i)}(^7r(i)) and 

-2 no 

i > 1, 



-^0 ^ 



D 



P{7r(i)}(''ir(i)) is positive. Since e Bt:^i{D), we can 
decrease ?'7r(i) keeping Tq G 3^^,1(0) so that it arrives at 



'7.(1) 

= or a positive r*f^^^ satisfying 

('^0,<(i),r{,r(l)}o) 

= (ro,<(i),0^_^)e9Z?,,i(i?). 

L-l 

Ml 



(36) 



Let (i?o, -fi^T(i)' ■'''-^7r(L)) ^ '^^'■^ vector corresponding 
to (ro, r;^^), r{^(i)}o). If r*^^-^ = 0, then by Property [3] part 
b)' P{7r(i)}(''7r(i)) must be zero. This contradicts the fact that 
P{ir(i)} (^7r(i) ) is positive. Therefore, must be positive. 

Then, from ( [36] ), we have 

(i?0, -R^(l), • • • , Rl(L)) 

= (i^o,i^:(l),o^-^)e7^f'(i?). 

L-l 

On the other hand, by Lemma |5] we have 

Gp,ro,r^-2)| 



l'-{„(l)}c=0 

7r(l) 

= n [i+4,.9fcp-'^o, 
fc=i 



0.r''(i)-i=0 



fc-l\ 



(37) 



-(i)-i=0 

From ( |35] | and ( |37] ). we can see that GfZ?, rn, r^^^)| 

— — ^ ''"{^(1)}'^='^ 

does not depend on r^(i). This imphes that P{7r(i)}(T'7r(i)) is a 
monotone increasing function of r^(i). Then, we have i?7r(i) > 
R* ,T,. Hence, we have 

{Ro,R-!t{1), ■ ■ ■ , R-n{L)) 

= (i^o,i^.(l),o^^)e7^f^(i?). 

L-l 

Thus, the claim holds for 1 = 1. We assume that the claim 
holds for 1 — 1. Since /o(?'o) is a monotone increasing 
function of r^rf;) on Bt^,i{D), we can decrease r^rj;) keeping 
Tq G B-,r,i{D) so that it arrives at r*^;^ = or a positive r* 
satisfying 

('^c^fo^^MOlO (38) 



(I) 



Let (i?o, i?: 



(1)' 



,Rl 



^7r(L)-' ^ '^^'■^ vector corresponding 
. By Property |4] part b) and the Ml 
condition, the I functions 

P{7r(i),---,7r(i)}(''{7r(i),---,7r(;)}l''{7r(l)---,7r(i-l)}) 
-P{7r(i+l),--v7r(;)}(^{7r(i+l),---,7i-(i)}k{7r(l),-,7r(i)}) 

for i = 1,2,- • - 1 , 

P{7r(0}(^7r(i)k{7r(l),---,7r(i-l)}) , 



appearing in the right members of ( |33] | are monotone increas- 
ing functions of r7r(i). Then, from (|33] |. we have 



R^(^) > Rl(i) for i = 1,2,-- 

R^^^) = = for i = / + 1, • • • , i 

When r. 

Then, by induction hypothesis, we have 

(i?o,i?:(n,---,i?:(L))e<'"^(7^) 



(39) 



^(;) - 0, we have (j-q, , r{,r(i)}0 e S^r^i-iP). 



When r*j;^ > 0, from ( |38] |. we have 

(i?o,i?:(l),■••,i?:(L))e7^f)(^)• 

Hence, by (|39]) , we have 

{Ro,R-k(1), ■ ■ ■ Mtt(L)) 

= iRo,R.{i),---,R.{i),0^_^)en^t\D)- 

L-l 

Thus, the claim holds for I. This completes the proof of 
Lemma [T] ■ 
Proof of Lemma |2} For i?o > and for 1 < Z < L, set 

Bi{D\RQ) = {r' ■.{Ra,r'^)eBi{D)}, 
dBi{D\Ro) = {r' : (i?o,r^) e dBi{D)} . 
We first observe that 



„L-2 L\ 





iD,Ro) 


= min 


min 


1<1<L 


r'eBi{D\Ro) 


d(u) 
-"'sum.L 


(DMo) 


= mill 


min 



1<1<L lr'edB,{D\B.o) 

We compute J\{D,Ra, r^^^ _q • By Lemma|5] for 

r'eBi{D\Ro) 

From the above formula, we can see that for r' e Bi{D\Ro), 
G{D, Rq, r^~^) \j.L ^0 is a function of r'^^. We denote this 
function by G{D, Ro,r^~^), that is, 
I 

G(I?,i?o,r'-i) = n [l + 4,.gfc(I?,i?o,r^-i)] . 

A:=l 

Then, for r' G Bi{D\Ro), 
1 



G(Ai?o,r'-i).^c-2^°n^"'" 

i=l 



(40) 



We denote the right member of (|40] | by Ja(I?, i?o, f ' mo- 
using this function, i?^!],,^ ^(-D, i?o) can be written as 



<m.Lp,^:o)= niin 



i<;<L 



mill Ja{D,Ro 

r'eB,{D\Ro) 
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Note here that JA{D,Ro,r' 



i-i 



is a monotone increasing 



function of n. To prove R^2m,LiD, Ro) > RillA^, Ro) , it 
suffices to show that for 1 < I < L, 



mm 

r'eBi{D\Ro) 



JA{D,Ro,r'~\r') > 



min K^ir ) . 

r'edBi{D\Ro) 



We prove this claim by induction with respect to I. When 
I = 1, the function J\{D, Rq^vi) is computed as 



JA{D,Ro,n) 



log+ 
log+ 



{l+a%^gi(D,B.Q}}a%^c-^-''Oc^ 



Since ^° ^ > 1, J\{D,Ro,ri) is positive. Since 

Ja{D, RQ,ri) is a monotone increasing function of ri, the 
minimum of this function is attained by rl = or a positive 
rl satisfying rl G dBi{D\RQ) . If rl — 0, then, by Property 
|3]part b), Ja{D, Ro,ri) must be zero. This contradicts that 
Ja{D, Ro,ri) is positive. Therefore, rl must be positive. 
Then, by rl e dBi{D\Rn), we have 

JA{D,Rf),ri) > JA{D,Rf),rl) 

= A'A(r*) > min AA(ri) . 

riedBi(D\R„) 

Thus, the claim holds for / = 1. We assume that the claim 
holds for / — 1. Since Ja{D, RQ,r^~^ ,r'') is a monotone 
increasing function of ri, the minimum of this function is 
attained by r^ = or a positive r^ satisfying (r'^^,r;*) G 
dBi{D\Ro) . When rf = 0, we have r'^^ e Bi-i{D\Ro) and 



Jk{D,Ro, 



Computing J a{D, RQ,r \r ?-;*), we obtain 



> JA{D,Ra, 



(41) 



JA{D,Ro,r'-\r'-^rt) 
JA{D,Ro,r 

1 



■log^ 



GiD,Ro,r'-')-^e 



i-i 



= JA{D,Ro,r'-\r'-^). 



Combining (l4Tl i and ( l42b . we have 

JAiD,Ro,r'-\r') > Ja{D, Ro,r'-\r'-^) . 
On the other hand, by induction hypothesis, we have 



JAiD,Ro,r'-',r' 



> min A'A(r'"M. 

r'-^edBi-i{D\Ro) 



(42) 
(43) 
(44) 



Combining ( |43] | and (l44l i. we have 



JA{D,Ra,r' 



t-i ^i) > 



min KaIt 

r'-iedB,-i{D\Ro) 

> min KA(r^)- 

r'edBi{D\Ro) 



When rt > 0, we have 



JAp,i?o,n-i,r') > JAiD,Ra,ri^i,r' 
^ KA{ri-ir*i ) 



> min KaIt ) . 

r'eaBi{D\Ro) 



where the second equality follows from (r' G 
Z)|i?o) ■ Thus, the claim holds for /, completing the proof. ■ 



VI. Conclusions 

We have considered the Gaussian many-help-one problem 
and given a partial solution to this problem by deriving explicit 
outer bound of the rate distortion region for the case where 
information sources satisfy the TS condition. Furthermore, we 
established a sufficient condition under which this outer bound 
is tight. We have determined the sum rate part of the rate 
distortion region for the case where information sources satisfy 
the TS condition. 

For the case that information sources do not satisfy the 
TS condition we can not derive an outer bound having a 
similar form of 71'-°''^^ (D) since the proof of the converse 
coding theorem depends heavily on this property of informa- 
tion sources. Hence the complete solution is still lacking for 
Gaussian information sources with general correlation. 



Appendix 

A. Proof of Proposition Q] 

In this appendix we prove Proposition [T] To prove this 
proposition we give some preparations. For < I < L — 2, 
we set 

Vi = m{D,ro,r'^) 
A j 9o{D,ro), for ? = 0, 

= ] gi{D,ro,r'~^)^^{l~e-^''), for 1 < Z < L - 2 . 
For 1 < ^ < i — 2, and a < -k-, define 



A 



4-(i-c--) 



Then, {'>]i}f^Q satisfies the following: 

r,i{D,ro,r')^Ti {m-i{D,ra,r'-^)) 
for 1< ; < L - 2 . 



(45) 



Fix a < — and set 



A 



PA; (a) = sup<^ p :log Y 



l-ct. . _ a]- 



>p{b-a) 



for any b < -iji- 



By a simple computation we have 

Pk{a) = 



, ^!;^^ , for < a < , 
, for a < 



< 



1 — crd a 



for a < -ji- 



(46) 



Fix a < -4- and set 



A 



qj{a) = sup'j q : Tj{b) — Tj(a) > q{b — a) 
for any b < -4- 
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By a simple computation we have 

qj{a) = 



J. — \ — yT , for < a < 



0, 



< 



for a < 
for a < -4- ■ 



(47) 



Proof of Proposition [7} Let £ be a set of integers I such 
that i]i{D, ro, r') is positive for some Tq e Bl{D). From ( l45T l, 
there exists a unique integer 1 < L* < L — 2 such that C 
^ {0, 1, • ■ • ,L*}. Using {r7/}tf and L*, logG{D,ro,r^-') 
can be rewritten as 



L-l 




^log{l + 4^.g,(i?,ro,r'^~')} 


fe=i 




L-l 






1 


l-cr?._ [»7&_i(_D,ro,rfc-i)] 


+ 


fe=l 




L-2 






fc=0 


1 








L* 






El°g 


1 






< 


fe=0 







Fix nonnegative vector r^. For each s/ > r;, 1 < / < L — 2, let 
G{si) be a function obtained by replacing n in G{D, 7'o, r^~^) 
with s;, that is 

G{si)^G{D,ro,r'-\si,rf^-,^). 

It is obvious that when si = ri. 

Gin) = G{D, ro, r'-i, r;, rf+f ) = G{D, tq, r^'^) . 

By Property [2] part b), we have G{si) < G{ri) for 1 < Z < 
L—2. For each Sk > rk, I < k < L — 2, let rik{si) be a function 
obtained by replacing n in r]k{D,ro,r^) with s;, that is 



A 



misi) ^ miD,ro,r ,s;,r;+i). 
It is obvious that when si = ri, 

By Property [T] part b), we have < Vki^i) for I < k < 

L — 2. For each i = 1, ■ • • , L*, we evaluate an upper bound 
of log G(s;) — log G(r;). Using ( |48] l. we have 



1 G{si) 

log = log 



Elog 

k=l 



^ 



(49) 



By definition of Pfe(-), we have 



log 



> Pk{r]kiri)) [rik{si) ~ Vkin)] 
>T^^^^^[Vk{^i)-Vk{ri)], (50) 



where the last inequality follows from ?yfe(.s;)< rik{ri) and 
( |46l ). From ( |49l ) and jSOl ). we have 



log 7^ >l^- 



G{ri) 



k=l 



, Ikiri) 



ivk{si) - ?/fc(n)) ■ (51) 



By definition of qj{-) and (05]), for / + 1 < j < fc, we have 

^ [??j-i(s/) - Vj-iiri)] , 



> 



(52) 



where the last inequality follows from rij^i{si) <ijj-i{^i) and 
( |47] ). Using ( |52] ) iteratively for ? + 1 < j < fc, we obtain 



Vk{si) - rikiri) 



k 



>im{si)-m{n)) J] 7 ^ — 

j=i+i (^i-'^l/'j-i j 

Observe that 



(53) 



> 



(54) 



From ( l53T l and ( l54b . we have 



(55) 



From ( fSTT i and i55[ . we have 

1, Gisi) 

By Property [T] part b) and the definition of r/j, we have 



.(56) 



Vj < /, - ^(1 
from which we have 



7i 



l — ai, r]j 



< 



l+4,,,/, + l<l+4,,,/ 



J + 1 



(57) 



From ( |56] | and dSTb . we have 



If 



' 3=1 + 1 



k=l 
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hold for / 1, 2, • • • , L - 2, then, by (|58]l, we have 



1 1 G{si) 



or equivalent to 



si + i log 0(5;) > ri + ilogG(n) 



for I = 1, 2, • • ■ , L — 2. Hence, (|59] ) is a sufficient condition 
for the MI condition. ■ 

B. Proof of TZl{D) C TZ^°'''\d) 

In this appendix we prove TZl{D) C TZ^^^*'\d) stated in 
Theorem |2] We first present a lemma necessary for the proof 
of this inclusion. 

Lemma 6: 



^(^"'^")^2^°gVA(x„,x„; 

Proof: See the proof of Lemma 1 in Oohama Q. ■ 
Next, we present an important lemma which is a mathe- 
matical core of the converse coding theorem. Let the encoded 
outputs of Xi,i = 0, 1,---,L by encoder functions (pi be 
denoted by ipi{Xi) = Wi. Set 

ro = -IiXo;Wo\W'^), 
n 

n^-l{X,-W,\Y'^-^) 



I{X,-W,\Y,), forl<i<L-l, 



A 



1 

n 

-I{Xl;Wl\Yl^i), for^ = L, 
n 

2 -^.i^Xo-WoW^) 



Then, we have the following lemma. 

Lemma 7: 

/(Xo;W^^)<|log[l + <Tijo(r^)] ■ 

For 1 < ^ < L — 1, we have 

^log [1 + 4,5/(^-0, 

< I{Yi-Wt\Yi^,) < ^ log [1 + alMrl)] . 

From the above lemma we immediately obtain the follow- 
ing. 

Lemma 8: 

I{Y'^-';Ws\Xo) < ^logFirs), SCA, 
/(F^-i;M^^|Xo) > ^logG(C,ro,r^-2). 

We prove TlLiD) C 7^^™*^(L>) by Lemmas |6] and g] and 
standard arguments for the proof of the converse coding 
theorem. 

Proof of ULiD) C n^°''^\D): We first observe that by 
virtue of the TS condition, 

Ws^Xs^ (Xo, Z^-^) ^ Xsc ^ Ws^ (60) 



hold for any subset S of A. Assume (i?o,-Ri, ■■■,Rl) G 
TZl{D). Then, for any S > 0, there exists an integer no{6) 
such that for n > no{S) and for i 6 A, we obtain the following 
chain of inequalities: 

n{Ro + 5)> logA/o > H{Wo) > H{Wo\W^) 

= /(Xo;VFo|VF^) =nro. (61) 

Furthermore, for any subset 5* C A, we obtain 

nro + ^ n{Ri + 6) 

ies 

> I{Xo;Wo\W'')+Y,H{W,) 
= H{Wo\W'')+J2h{W,) 



> H{Wq\WsWs-^) + H{Ws\Ws^) = H{WoWs\Ws^ 
= I{X„z''~';WoWs\Ws^) 



-HiWoWslWs'^XaZ 



L-l\ 



IiXoZ'^-';WoWs\Ws^)+J2HiW,\XoZ'^-^) 
= I{XoY''-';WoWs\Ws^)+J2i{X,;W^\Y''-'). (62) 



les 



Step (a) follows from (|60] |. On the other hand, by Lemma |6] 
we have for n > no ((5), 



>/(Xo;Xo) > -log( , 

which together with (ISTT i. ( |62] |. and Lemma [8] yields the 
following lower bounds of I{Xo;Wo\W^) and I{XoY^^'^ 
;WoWs\Ws^y. 

/(Xo; l^olM^"^) = /(Xo; WoW^"^) - /(Xo; W^^) 

2 



^ " 1 

> 2log 

n 

> — log 
- 2 B 



{l+'^i„/o('-^)|« 



/(XoY^-^M^oW^slW^sO 
liXoY"^-'; WoWsWs^) - I{XoY''-^;Ws^) 
/(Xo; WoW^) + /(r^-i; ly^lXo) 
-/(Xo; W^sO - /(>^''"'; W^s^Xo) 

_F(rsc){n-a|^/o(rso)}5_ 

G(D+a,ro,r^-") 
_F(rsc){l+a|^/o(rso)}(D+5)_ 

From ( |62] | and ( l64b . we have 



(63) 



n 

> ^log 
n 

> ^log 



(64) 



ies 



<T^pG(D+i5,ro.r^-") 
='(rsc)(D+<5){l+<Tj^/o(rsc)} 



+ X! ~ ^0 



(65) 
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Note here that X]ies(^« ^" ^) nonnegative. Hence, from 
(leTT i. (l63] l and (l65]l, we obtain 



Ro+S>rn>-\oi 



and for S" C A 

E 



{l+<Ti^/o(r^)}(i3+5) 



(66) 



The inequahty (|66] | implies that rg S Sl( D + 6). Thus, by 
letting 5 0, we obtain {Ro, Ri, ■ ■ ■ , Rl)& 7^^™*'(i:'). ■ 

Finally, we prove Lemma |7] For n dimensional random 
vector U with density, let h{U) be a differential entropy of i7. 
The following two lemmas are some variants of the entropy 
power inequality. 

Lemma 9: Let Ui,i = 1,2,3 be n dimensional random 
vectors with densities and let T be a random variable taking 
values in a finite set. We assume that C/3 is independent of 
Ui, U2, and T. Then, we have 

_J_ 2.h(U2+U3\UiT) > _i_Qih{U2\UiT) I 1 r^h(U:i) 
27re — 27rc 27rc 

Lemma 10: Let [7^, i = 1, 2, 3 be 77, random vectors with 
densities. Let Ti,T2 be random variables taking values in 
finite sets. We assume that those five random variables form 
a Markov chain Ti Ui U3 U2 T-i in this order 
Then, we have 



J_eiHUi+U2\U3TiT2} 

27re 

> 1 e*Mt/i|c/3Ti)^ 1 , 

— 27rc 27TC 



,^h{U2\U3T2 



Proof of Lemma [7} Define the sequence of n dimensional 
random vectors { Si}^S^ by 



Si = -^Xi + -^Yi+i, 1<1<L-1. 
By an elementary computation, we obtain 



Y, 



<7lSi + Ni,l<l<L-l. 



(67) 



(68) 



where AT;, 0<Z<L — lisann dimensional random 
vector whose components are n independent copies of a 
Gaussian random variable with mean and variance al- . 

Nq is independent of l^i. For each 1 < / < L — 1, iV/ is 
independent of and Si. The variance cr^ , < I < L — 1 
have the following form: 

1 1,1 



No 



1 </<L-l, 



(69) 



Set 



2lTC 



2lTC 



Mo 



A 



\h{Yi\XoW^ 



2irc^ 



ZTTC " — — 

27rc 

1< / < L - 1. 



27rc 



We can easily verify that 

Ao = MoAo^ = mA;^ , 1 < ^ < L - 1 . (70) 

No N, 

Applying Lemma |9] to ( |68] ). we obtain 



t1 it/ + cr?- 

From dTOl i and ( ItTI ). we obtain 

-1/1 I 1 



(71) 



Ao < ^ 

Ar' < ^ 



1-4^ 

^ f^i,l<l<L-l. 



(72) 



On the other hand, we note that for each 1 < I < L — 1, the 
five random variables Wi, Xi, Yi, Yi^i, and W/l^ form a 
Markov chain Wi ^ Xi ^ Yi ^ M^,^^ in this 

order. Then, applying Lemma [TOl to ( |67] i. we obtain 



-A/+i,l </<i-l. 



(73) 



Combining ( |72] | and ( |73] |. we obtain for 1 < / < L — 1, 

Ar^ < ^ + ^(1 - + ^ (1 - ^) .(74) 

A 

we have 



Set I'D = Ag - = A, 



1 < ; < L - 1 . Then, 



/(Xo,M/^) = -log(l + a|^,:/o), 
liYi, W^Yi-i) = ^ log(l + 4,^^;) , 1 < ^ < ^ - 1, 



IiYL,WL\YL-i) ^-\og{l + al^UL) 



nrL 



Note that i'/ , < ^ < L — 1 are nonnegative. From ( l72b and 
(l74l i. {I'/I^o satisfies the following recursion: 



n < 



1+cr-i VL 



71 



-1) > 

l-C^^'^-L-l 
<L-, 

l-o^^'^-f'-i 
, l-c-^n 



"72- 



1+cri, I'l 



,L-2>1>1, 
1 



(75) 

(76) 
(77) 
(78) 



From (iTSll-jTSll, we obtain the upper bounds of I{Xq]W^) 
and I{Yi; M^,^|Y/_i), 1 < Z < L - 1 in Lemma |7] On the 
other hand, from (iTTl i. dTST l, and the nonnegative property of 
J^i, < / < i — 1, we have 
1 + 



,^^1 > - 



> 



4-(l-c 



(79) 



, 1 < ; < L - 1 . (80) 



From (|79] l and dSOl l, we obtain the lower bound of I{Yi; 
Wi^\Yi^i), 1<1<L-Im LemmaHl ■ 
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C. Proof of Lemma |5] 

Let 0^2, ^2 G AL{cti)- Then, we have the following chain 
of inequalities: 



or equivalent to 

Oi-iiu;) 



1 



ej_i6 



) + (1 - mm 

Pi , /3/+1 



7"! + ! 



(83) 



for L — 1>1>2. We first prove ( fTTI ) for I = L. The equation 

1 



+ (l-t)log( 1 

L-l 



1 - 6/3/ r;+i 
^ {t log (1 - eai) + {l-t) log (1 - epi)} 



1=1 

+t log(l - ul) + {l-t) log(l - (3l) 

L-l 

Oil , ,ai+i 



OL-iito) 
is equivalent to 

OL-l{io) 



2ei.(^)-i 



26)i,(i^)-l 



1 



(84) 



(a) tz,^ r 

< ^log l-f 

/=1 



,1 - eL-\QL-\{'^) 
It is obvious that 



-1 -0lH=0lH-1. (85) 



L-l 



-(l-t)^ + (l-t)^ 

1 - ep; r;+i 

+ ^log{l-e[to, + (l-t)A]} 
1=1 

+ log{l-[iaL-(l-i)/3L]} 
to, + (1 - 0/3, 



< =u <\ 



(86) 



From ( [85] l and ( [86l ). we have 

^L-l(c^) 



(b) ^1 r 

/=i 



From 



(\tai + (1 - t)A] 
to,+i + (1 - t)A+i ' 



1 - 

and Ti > 1, we have 

iTL6'L_i(a;) 



-1 <eLH 



< 



1 - eL-i6'L-i(w) 1 - eL-i6'L_i(w) 



Ti+i 

^log{l-e[to, + (l-<)A]} 



L-l 



Thus, ([TtT i holds for ? = i. We assume that ( [TtI i holds for 
some I + 1 with L > I + 1, that is. 



1=1 

+ l0g{l-[toL + (l-i)/3L]} 

= C(to2 +(l-t)/32'') ■ 

Step (a) follows from the strict concavity of the logarithm 
function. Step (b) follows from the strict concavity of jEf^ 
for a > 0. ■ 



D. Proof of Lemma 

Proof of Lemma |?] part a): For the proof we use the 
following inequahty: 

1 + a 



o<ez+iH<^^, 

(T^fe-i)<%iH<^r+i 

From dSTl i. we obtain 



(87) 



>o, 



i+- 



l + .M + ^ 



(88) 



Using 



< 



1 



1 + e(l + a) 1 + ea ~ 1 + e 
The recursion of ( fT5] l is equivalent to 



r,6'i_i(u;) 



1C/-1 



261, 



Tl + l 



(81) 



Tl (82) 



we have 

r;6';_i(a;) 
1 - e/_i6'/_i(w 
1 - 

Oiiiu) 

1 + ( 1 



-Oiiu;) 



Tl + l 



9i + i(c^) 



(a) 
Tl < Tl 



for L— 1 > Z > 2. Applying dSTT l to the second term in the right 
members of ( [82] ) and considering the assumption t, > 

for L — 1 > Z > 2, we have 



Step (a) follows from the second inequality of 
we have 



1C,-1 



r,6'z_i(w) 



l-ei- 



117,-1 



> 20, (w) - 



ei+i(uj) 
n+i 



Using 



(a) 

> 0. 



l + ei 



Step (a) follows from the first inequality of (|88l l. Thus, (fTTj i 
holds for /, completing the proof. ■ 
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Proof of Lemma^ part b): We first observe that 



1=1 ^ ^ 

-log(l - ul) 

L 



h +log(l - eiai 

1 - e;a/ Ti+i I 



= ^log |l - ei-iai-i - + (1 - e;_iQ!/_i)^| 



1=2 

+ log(l - Ul) 
L-1 



1=1 



1 



l + ei 1 



ai+i 

Tl+l 



• Oil 



^log(l - Ul) . 
Computing gf^C(Q^2 ) obtain 



^Z,-1"Z,-1 



1 — 



for L - 1 > Z > 2 . 



From ( [89] ). when VC(a2 ) = 0^ ™ust satisfy 



(89) 



-2aL + 1 + r/ 



1+- 



l+ei 



1+ 



0, 

--11=0. 



y (90) 



for L - 1 > ? > 2 . 
From ( |90l ). we obtain 



O-L-l = 



2aL-l 



2a/ 



2ar -1 



Oll-l 



n 



1 



2ai 



i+- 



l+e, 1+- 



for i - 1 > Z > 2 . 



(91) 



The relation ( |9T] l implies that VCI^jt^gi^^^) =0. ■ 
Proof of Lemma |?] /^arf cj; For the proof we use the 
following recursion: 



l-q0/_iH 



l + Q[l + %i(a;)] 



1. (92) 



Taking the derivative of both sides of ( |92] i with respect to lo, 
we obtain 



1 



1 



{l + e;(ei+iH + l)} 



dtj 



'i+i 



(93) 



Since ^2(0^) £ Al{Pi{uj)), we have 



1 - ei^iOi^i{uj) 
The above inequality is equivalent to 



-1 <e;H 



1 + 



1 > 



ic;-i 



From ( l93T l and ( l94b we have 



l+Ci-l ( ^^ + 1 I \ ^^-Tl 



> 2 



d^ 

duj 



{l + ,(^ + l)} 
The above inequality is equivalent to 



dcj 



> 2 



l + ei-i { ^^ + 1 



1 de, 



1 dg;_i 

f^f-i do) 



(7;^ dCJ 



{l + ,(^ + l)y 

1 d0,+i~ 



o-f+i dw 



For 1 < ; < L, set 



dw ai {i+.,(^+i)}^ 

L-l 
J=2 



n 



J=2 



Set 



(94) 



'''"^ -r.\ • (95) 



(96) 



Then, by (|96l l, we have 

> 2$z(w) - for 2 < / < L - 1 . (97) 

From ( |97] l we have 

$;„l(tj) - > - <^i+i{uj) 

1 d9L-i 1 1 



(98) 
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Then, by d98T l, we have 

<Pi{uj) > <i>L{uj) + {L-l)A{uj) 

2{L-l) 



L-{1+1) 



from which we obtain 



d9j_ 
duj 



> 



L-{1+1) 



L-1 

n 



a 



completing the proof. 
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